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Abstract 

We construct a new map from a convex function to a distribution on its domain, with the 
property that this distribution is a multi-scale exploration of the function. We use this map to 
solve a decade-old open problem in adversarial bandit convex optimization by showing that 
the minimax regret for this problem is 0(poly(n)\/T), where n is the dimension and T the 
number of rounds. This bound is obtained by studying the dual Bayesian maximin regret via 
the information ratio analysis of Russo and Van Roy, and then using the multi-scale exploration 
to solve the Bayesian problem. 


1 Introduction 

Let JC C M n be a convex body of diameter at most 1, and / : JC — > [0, +oo) a non-negative 
convex function. Suppose we want to test whether some unknown convex function g : JC —> M is 
equal to /, with the alternative being that g takes a negative value somewhere on JC. In statistical 
terminology the null hypothesis is 

H 0 : 9 = /, 

and the alternative is 

Hi : 3 a E 1C such that g(a) < —e, 

where £ is some fixed positive number. In order to decide between the null hypothesis and the 
alternative one is allowed to make a single noisy measurement of g. That is one can choose a 
point x E JC (possibly at random) and obtain g(x) + £ where ( is a zero-mean random variable 
independent of x (say £ ~ A/”(0,1)). Is there a way to choose x such that the total variation 
distance between the observed measurement under the null and the alternative is at least (up to 
logarithmic terms) e/poly(n)? Observe that without the convexity assumption on g this distance 
is always 0 (£ n+1 ), and thus a positive answer to this question would crucially rely on convexity. 
We show that e/poly(n) is indeed attainable by constructing a distribution on 1C which guarantees 
an exploration of the convex function / at every scale simultaneously. Precisely we prove the 
following new result on convex functions. We denote by c a universal constant whose value can 
change at each occurence. 
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Theorem 1 Let 1C C R"' be a convex body of diameter at most 1. Let f : 1C —* [0, +oc) be convex 
and 1-Lipschitz, and let e > 0. There exists a probability measure p on 1C such that the following 
holds true. For every a G 1C and for every convex and 1-Lipschitz function g : 1C —$■ R satisfying 
g(a ) < —£, one has 


pilxelC: | f(x) -g(x )| > 


n 7 - 5 log(l + n/e] 


ma x(e,f(x)) 


> 


n 3 log(l + n/e) 


Our main application of the above result is to resolve a long-standing gap in bandit convex 
optimization. We refer the reader to Bubeck and Cesa-Bianchi [2012] for an introduction to ban¬ 
dit problems (and some of their applications). The bandit convex optimization problem can be 
described as the following sequential game: at each time step t = 1,... ,T, a player selects an 
action x t G 1C, and simultaneously an adversary selects a convex (and 1-Lipschitz) loss function 
it : 1C hg [0,1]. The player’s feedback is its suffered loss, i t {x t ). We assume that the adver¬ 
sary is oblivious, that is the sequence of loss functions i 1: ... ,i T is chosen before the game starts. 
The player has access to external randomness, and can select her action x t based on the history 
H t = (x s ,i s (x s )) s<t . The player’s perfomance at the end of the game is measured through the 
regret : 

T T 

R t = ^T j it{x t ) - min ^ i t (x), 

t =i t =l 

which compares her cumulative loss to the best cumulative loss she could have obtained in hind¬ 
sight with a fixed action, if she had known the sequence of losses played by the adversary. A major 
open problem since Kleinberg [2004], Flaxman et al. [2005] is to reduce the gap between the y/T- 
lower bound and the T 3 / 4 -upper bound for the minimax regret of bandit convex optimization. In 
dimension one (i.e., K. = [0,1]) this gap was closed recently in Bubeck et al. [2015] and our main 
contribution is to extend this result to higher dimensions: 


Theorem 2 There exists a player’s strategy such that for any sequence of convex (and 1-Lipschitz) 
losses one has 

E R t < cn 11 log 4 (T)Vf, 

where the expectation is with respect to the player’s internal randomization. 


We observe that this result also improves the state of the art regret bound for the easier situation 
where the losses i ±,...,£t form an i.i.d. sequence. In this situation the best previous bound was 
obtained by Agarwal et al. [2011] and is 0(n 16 y/T). 

Using Theorem 1 we prove Theorem 2 in Section 2. Theorem 1 itself is proven in Section 3. 


2 Proof of Theorem 2 

Following Bubeck et al. [2015] we reduce the proof of Theorem 2 to upper bounding the Bayesian 
maximin regret (this reduction is simply an application of Sion’s minimax theorem). In other words 
the sequence (£±,..., (V) is now a random variable with a distribution known to the player. Expec¬ 
tations are now understood with respect to both the latter distribution, and possibly the randomness 
in the player’s strategy. We denote E ( for the expectation conditionally on the random variable If. 
As in Bubeck et al. [2015] we analyze the Bayesian maximin regret with the information theoretic 
approach of Russo and Van Roy [2014a], which we recall in the next subsection. 
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2.1 The information ratio 

Let iC = {x\ ,..., xk} be a 1/vT-net of 1C. Note that K < (4 T) n . We define a random variable 
x* G K, such that YCt=i ^t( x *) = min xe £ YCt= 1 Using that the losses are Lipschitz one has 

T 

Rt < Vf + Y t {£t{x t )-it{x*)). (1) 

t= i 

We introduce the following key quantities, for x G /C, 

r t (x) = E t (^(x) -£ t (x*)), and v t (x) = Var t (E t (£ t (x)jx*)). (2) 

In words, conditionally on the history, r t (x) is the (approximate) expected regret of playing x at 
time t, and v t (x) is a proxy for the information about x* revealed by playing x at time t. It will be 
convenient to rewrite these functions slightly more explicitly. Let i* e [K] be the random variable 
such that x* = Xi*. We denote by a* its distribution, which we view as a point in the K — 1 
dimensional simplex. Let a t = E t a*. In words a t = (ai,t,..., otK,t) is the posterior distribution 
of x* at time t. Let f i%t , f t : 1C —> [0,1], i e [K\,t e [T], be defined by, for x E 1C, 

ft(x ) = E t £ t (x), fi, t (x) = E t ((! t (x)\x* = x^. 

Then one can easily see that 

K K 

r t (x) = f t (x ) and v t (x) = ^2a iit (f t (x) - (3) 

1=1 2=1 

The main observation in Russo and Van Roy [2014a] is the following lemma, which gives a bound 
on the accumulation of information (see also [Appendix B, Bubeck et al. [2015]] for a short proof). 

Lemma 1 One always has E YCt=i v t{ x t) < ijlog(.K’). 

An important consequence of Lemma 1 is the following result which follows from an application 
of Cauchy-Schwarz (and (1)): 

T T 

E ^2 r t(x t ) < VT + Cj2VEv t (x t ) => ER t <2Vt + C 

t =i t =i 

In particular a strategy which obtains at each time step an information proportional to its instanta¬ 
neous regret has a controlled cumulative regret: 

E t r t (x t ) < ~^= + C\JEtv t (x t ), Vf e [T] E R r < 2a /T + C^J^log(K). (5) 

Russo and Van Roy [2014a] refers to the quantity E t r t ( x t )/ WE t v t (x t ) as the information ratio. 
They show that Thompson Sampling (which plays x t at random, drawn from the distribution a t ) 
satisfies E t r t (x t ) / i/E tv t (x t ) < K (without any assumptions on the loss functions £ t ■ 1C —* [ 0 , 1 ]). 
In Bubeck et al. [2015] it is shown that in dimension one (i.e., n = 1), the latter bound can be im¬ 
proved using the convexity of the losses by replacing K with a polylogarithmic term in K (Thomp¬ 
son Sampling is also slightly modified). In the present paper we propose a completely different 
strategy, which is loosely related to the Information Directed Sampling of Russo and Van Roy 
[2014b]. We describe and analyze our new strategy in the next subsection. 


T 


log (K). 


(4) 
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2.2 A two-point strategy 

We describe here a new strategy to select x t , conditionally on H t , and show that it satisfies a 
bound of the form given in (5). To lighten notation we drop all time subscripts, e.g. one has 
r(x) = f(x) - YJLi and v ( x ) = Eil a i ( fi( x ) - f( x )f- Our Objective is to describe a 

random variable X G /C which satisfies 

Er(X) < -±= + CyjEv{X), (6) 

VT 

where C is poly logarithmic in K (recall that K < (4T) n ). 

Let x* G argmin xe jcf(x). We translate the functions so that f(x*) = 0 and denote L = 
E£i ®ifi( x i)- If L > -1/Vf then X : = x* satisfies (6), and thus in the following we assume 
that L < —1/y/T. 

Step 1: We claim that there exists e G |L|/2,1] such that 

“ ({i e M : /ife) 2 - 2Iog(2/|L|)g ' (?) 

Indeed assume that (7) is false for all e G [|L|/2,1], and let Y be a random variable such that 

P(F = - fi(xi )) = on, then 

|L| = Eys |i|/2+ £/ (y a ■ W2+ L wm dx = |£| - 

thus leading to a contradiction. We denote I = {i e [K] : /((x*) < —£} with £ satisfying (7). 


Step 2: We show here the existence of a point x G /C and a set J C / such that a( J) > 

»3log(l + n/ £ ) tt ( / ) aIld fOT ^ e 

I/O) - /i(x)| > 7 5 ^ ' max(£, f(x)). (8) 

n'-° log(l + n/e) 

We say that a point is good for /j if it satisfies (8), and thus we want to prove the existence of a 
point x which is good for a large fraction (with respect to the posterior) of the /,’s. Denote 


Ai= \ x | f(x) - fi(x )| > 


?7,7.5 i 0 g(l + n/e) 
and let fi be the distribution given by Theorem 1. Then one obtains: 


max(e,/(x)) > , 


sup 

x£K. 


G A i}M x ) = otin(Ai) > 
ieT Jx&K ieI ieI 


n 3 log(l + n/e) 


«(/), 


which clearly implies the existence of J and x. 


Step 3: Let X be such that P(X = x) = a(J) and P(X = x*) = 1 — a(J). Then 

Er{X) = \L\ + a(J)f{x), 
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and using the definition of x one easily see that: 


y/En(X) > y/a(J)v{x) > a(J) ^ aff^x) - /(x)) 2 > n 7 .s log ^ + n / £ ^ a ^ max 0> /0))- 
Finally, since a( J) > — u / O—^—-, the two above displays clearly implies (6). 

3 An exploratory distribution for convex functions 

In this section we construct an exploratory distribution p of a convex function / which satisfies the 
conditions of Theorem 1, thus concluding the proof of Theorem 2. 

3.1 The one-dimensional case 

Since our proof of Theorem 1 will proceed by induction, our first goal is to establish the result in 
dimension 1. This task will be much simpler than the proof for a general dimension, but already 
contains some of the central ideas used in the general case. In particular, a (much simpler) multi¬ 
scale argument is used. 

The main ingredient is the following lemma which is easy to verify by picture (we provide a 
formal proof for sake of completness). 

Lemma 2 Let /, g : M — > K be two convex functions. Suppose that /(x) > 0. Let xq ,a G Ife 
two points satisfying a — 1 < xq < a, and suppose that g(a ) < —efor some e > 0 and that 

f(x) >0,VX> X 0 . (9) 

Let p be a probability measure supported on [,z'o, a] whose density with respect to the Lebesgue 
measure is bounded from above by some /3 > 1. Then we have 

p, ({x : | f(x) - g(x)\ > |/3 _1 max(e, /(x))}) > 

Proof We first argue that, without loss of generality, one may assume that / attains its minimum 
at Xq. Indeed, we may clearly change / as we please on the interval (—oc, x 0 ) without affecting 
the assumptions or the result of the Lemma. Using the condition (9) we may therefore make this 
assumption legitimate. 

Assume, for now, that there exists xi e [x 0 , a] for which f{xf) = g(x i). By convexity, and 
since /(xo) > 0 and g{a) < 0, if such point exists then it is unique. Let h(x) be the linear function 
passing through (a,g(a)) and (xi,/(xi)). By convexity of g, we have that | g(x) — /(x)| > 

| h(x) — f(x) | for all x 6 [x 0 ,a]. Now, since h(a) < —£ and since a < x\ + 1, we have 
h'(x 0 ) < — (e + /(x 0 )). Moreover, since we know that /(x) is non-decreasing in [x 0 ,a], we 
conclude that 

\g(x)-f{x)\ > \h(x)-f(x)\ 

= \K X ) ~ f( x i)l + I/O) - /001 
= 0 + / 0i))0 - x i\ + I/O) - / OOI 

> max(e, /(x))|x — xi|, Vxe[xo,a]. 
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It follows that 


{x; \f(x)-g(x)\ <\P 1 max(£,f(x))} C I := [x x - \jp 1 ,x 1 + \P 

but since the density of // is bounded by ft, we have //(/) < | and we’re done. 

It remains to consider the case that g{x) < /(x) for all x e [x 0 , a]. In this case, we may define 


• / \ / \ i f{x o) -g(x o), v 

SW = #(x) +-(a - x). 

a — x o 

Note that g(x) > g(x) for all x E [x 0 , a], which implies that | g(x) — /(x)| > |g(x) — /(x)| for all 
x 6 [x 0 , a]. Since g(x 0 ) = /(xo), we may continue the proof as above, replacing the function g 
by g. ■ 


We are now ready to prove the one dimensional case. The proof essentially invokes the above 
lemma on every scale between £ and 1. 

Proof [Proof of Theorem 1, the case n = 1] Let xo E /C be the point where the function / attains 
its minimum and set d = diam(/C). Define N = [log 2 + 4. For all 0 < k < N, consider the 
interval 

Ik = [x 0 — d2~ k , x 0 + d2~ k ] D /C 

and define the measure fXk to be the uniform measure over the interval Ik- Finally, we set 

_ 1 V" 1 * 

^~iV + 2^ /ifc+ iV + 2^ 0 - 

k =0 

Now, let a E /C and let g(x) be a convex function satisfying g(a) < —e. We would like to 
argue that/i(A) > 81og( i +1/e) for A = {x E 1C : |/(x) - g(x)\ > §}. 

Set k = [log 1 / 2 (|o! — x 0 |/d)]. Define Q(x) = x 0 + d2~ k {x — x 0 ) and set /(x) = f(Q(x)), 
g(x) = g(Q(x)), a = Q~ l (a) and consider the interval 

/ = Q _1 (4) FI {x : (x - x 0 )(a - x 0 ) > 0} 


It is easy to check that, by definition / is an interval of length 1, contained in the interval [xo, 5]. 
Defining J1 = /i/-, we have that the density of /i^with respect to the Lebesgue measure is equal to 
1. An application of Lemma 2 for the functions /, g, the points xo, 5 and the measure J1 teaches us 
that 





fix) - g{x) 




f(x) - g(x) 




By definition of the measure /i, we have that whenever k < N, one has 


u (A) > ->-. 

’ - N + 2 ~ 81og(l + l/e) 


Finally, if k > N, it means that \a — x 0 | < 2 N < |. Since the function g is 1-Lipschitz, this 
implies that g(x 0 ) < —e/2 which in turn gives |/(x 0 ) — g(x 0 )| > |. Consequently, x 0 E A and 
thus fi(A) > /i({x 0 }) = ]vT 2 > 8 i og (i + i/ e) - The Proof is complete. ■ 
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3.2 The high-dimensional case 

We now consider the case where n > 2. For a set Q c R" and a direction 0 E R" we denote 
Sn,e = {x E Cl : |(x, 6)\ < 1/4}, and /xq for the uniform measure on Cl. For a distribution /x we 
write Cov(/x) = ~E x ~nXX T . 

As we explain in Section 3.3 our construction iteratively applies the following lemma: 

Lemma 3 Let e > 0, L E [1, 2 n\. Let Cl C be a convex set with 0 E Cl and Cov(/xq) = Id. Let 
f : Cl [0, oo \ be a convex and L-Lipschitz function with /( 0) = 0. Then there exists a measure 
// on Q and a direction 6 E § n_1 such that for all a E Cl \ and for every convex function 
g : O —> M satisfying g(a ) < —e, one has 

( ‘({ IE “ : l/W “ » WI = 2 50 » 7 - 5 log(l + n/e) lnax(g ’ / (x)) }) > X. (10) 

The above lemma is proven in Section 3.4. A central ingredient in its proof is, in turn, the 
following Lemma, which itself is proven in Section 3.5. 

Lemma 4 Let £ > 0, C M n a convex set with diam(fl) < M, and f : O —> M + a convex 
function. Assume that there exist 8 E (0, z E D B(0, A), 6 E S n_1 and t > 0 such that 

((v/)- 1 (b (te, XX) ) ) > 1 / 2 . a D 

Then for all a E Q satisfying (a, 6) > | and |a| < 2 n and for all convex function g : Q —> M 
satisfying g (a) < —e, one has 

TB(Z,S) Qz e : \f{x)-g(x)\ > 2 13 m^ max ( £ >/(>))}) > \- 


3.3 From Lemma 3 to Theorem 1: a multi-scale exploration 

An intermediate lemma in this argument will be the following: 


Lemma 5 There exists a universal constant c > 0 such that the following holds true. Let e > 0, 
C M n a convex set with 0 E Q and Cov(/xq) = Id. Let f : Ll —> [0, 00 ) be a convex and 
1 -Lipschitz function. Then there exists a measure fi on O, a point y E Ll and a direction 6 E 1 
such that for all a E Q satisfying 


| (a 


y,o)\> 


C£ 

16 n w 


and for every convex function g : —» M satisfying g(a) < —£, one has 


dllxEtt: I/O) -g 0)| > 


77 , 7.5 iog(l + n/e\ 


■ max(e, f(x )) 


> 


n 2 log(l + n/e)' 


( 12 ) 
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3.3.1 From Lemma 5 to Theorem 1 

Given Lemma 5, the proof of Theorem 1 is carried out by induction on the dimension. The case 
n = 1 has already been resolved above. Now, suppose that the theorem is true up to dimension 
n — 1, where the constant c > 0 is the constant from Lemma 5. Let /C G R'" and / satisfy the 
assumptions of the theorem. Denote Q = Cov(/iy C )~ 1 ' /2 and define 

D = Q(/C), f(x) = f(Q~ 1 (x)) 

so that / : Q —* R. Since diam(/C) < 1, we know that for all u G Var [Proj u (J,k\ < 1 which 
implies that ||<5 _1 || < 1. Consequently, the function / is 1-Lipschitz. We now invoke Lemma 5 
on fl and / which outputs a measure a point y G fl and a direction 6. By translating / and /C, 
we can assume without loss of generality that y — 0. Fix some linear isometry T : R n ~ 1 —* 0 ! . 
Define 

fY = (Sln{r: | (x, 6 1 ) | < 5}) 

where 5 = Y^fnr and c is the universal constant from Lemma 5. Since / is convex, there exists 
/ C R x R" so that 

f(x)= sup (a + (x, y )), Vi G O. (13) 

(a,y)G/ 

We may extrapolate f(x) to the domain R" by using the above display as a definition. We now 
define a function h : Q' —> M by 

h(x) := sup f(T(x) + wO). (14) 

wE[— < 5 ,( 5 ] 

It is clear that diam(O') < 1. Moreover, h is 1-Lipschitz since it can be written as the supremum 
of 1-Lipschitz functions. We can therefore use the induction hypothesis with fY, h(x) to obtain a 
measure /i 2 on (Y. Next, for y G M n_1 , define 

N(y) := {iGfl: Proj 0 ±x) = y] 


and set 


XW) = -di(«W) 
n 


n 


n 


Vo\ 1 (Q(W)nN(u)) 
Voli (IV(-u)) 


dfi 2 (u) 


for all measurable IP C R". 

Fix a G /C, let g : /C —> R be a convex and 1-Lipschitz function satisfying g(a) < —e. Recall 
that c denotes the universal constant from Lemma 5. Define 


A = 1 x G K .: | f(x) -g(x )| > 


77,7.5 log(l + n/e) 


max(£, f(x)) 


The proof will be concluded by showing that y(A) > 


_ C _ 

n 3 log(l-(-n/£)" 
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Define g(x) = g(Q 1 (x)) and remark that g is 1-Lipschitz. First consider the case that 
| (Qa, 0)| >5, then by construction, we have 

KA) > -MQ(A)) 

n 

= -Vi ( \x e ft; \f(x)-g(x)\ > -— ma x(e,f{x)) 

n n‘- b log(l + n/e) 

(12) c 

> - , 

n 3 log(l + n/e ) 



and we’re done. 

Otherwise, we need to deal with the case that | {Qa, 6)\ < 5. Define q(x) to be the function 
obtained by replacing f(x) with g(x) in equation (14) and consider the set 


A ' = r e lh(x) ~ « (:C)I =' („-1)7.5 io g (i + n/£) 1 na X ( £ ,ftM) 

By construction of the measure fi 2 we have ^{A') > ( rt _i) 3 l0 g( 1+n / e ) - We claim that N(A') C 
Q(A), which implies that 



77 — 1 

g(A) > - ^(A') > 


n 


n 3 log(l + n/e ) 


which will complete the proof. Indeed, let y e N(A'). Define z = T 1 (Proj e ±j/), so that z <G A'. 
Let wi,W 2 € N(z) be points such that 


h(z) = f(w i), q(z) = g{w 2 ). 

Such points exist since, by continuity, the maximum in equation (14) is attained. Now, since 
z E A', we have by definition that 

— c — 

|/(wi)-sWI > 7 - n75 ' n , -7Tmax(e,/(«)i)). 

(n — 1) ( - b log(l + n/e) 

Finally, since the functions /, g are 1-Lipschitz, we have that 


1/(2/) - g{y )I > l/(^i) - g{w 2 )| - |/(2/) - f(w i)| - | g(y) - g(w 2 )\ 


> 


> 


(n — l) 7 - 5 log(l + n/e) 
c 

in — l) 7 - 5 log(l + n/e ) 
c 

(n — l) 7 - 5 log(l + n/e ) 


max(e, /(wi)) - \y - w ± \ - \y - w 2 \ 
max(e, f(y)) — 4<5 


ma x(e,f(y)) - 


ce 

477, 10 


> 


ma x(e,f(y)) 


n 7 - 5 log(l + n/e) 
which implies, by definition, that y e Q(A). The proof is complete. 
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3.3.2 From Lemma 3 to Lemma 5 

We construct below a decreasing sequence of domains D Di D ••• 3 Ll N . Let x 0 G Ll be 
a point where f(x) attains its minimum on fl Set f2 0 = D — x$. Given i > 0, we define the 
domain Q i+ i, given the domain Qj, by induction as follows. Define Qi = Cov(/iQ i )^ 1 / 2 and 
!i(x) = f(Qi'(x + x c )) - f(x o). We have 

|V/.W| = |Q- 1 V/(Q- 1 (x))|<||Q- 1 ||. 

Now, by Lemma 8 we know that 


diam(Oj) < diarn(O) < n + 1 

which implies that ||Q ? rl || < n + 1. We conclude that /* is (n + 1)-Lipschitz. We may therefore 
invoke Lemma 3 for the function /, : defined by on the set with L = n + 1. This lemma 
outputs a direction 0 and a measure fi which we denote by (l, and //, respectively. We define 

^i+l = Qi 

Equation (10) yields that for a universal constant c > 0, 

Hillx-xo: | f(x) - g{x)\ > - i-r max(e, f(x)) > ) > - (15) 

\ ( n‘- b log(l + n/e) )) n 

for all functions g(x) such that g(a) < —e, whenever a G Dj \ D* +1 . 

Fix a constant d > 0 whose value will be assigned later on. Define 5 = and let 

N = min{;< : 3 9 G S n_1 such that |(x, 6)\ <5, Vx G Dj}. 

In other words, N is the smallest value of i such that D* is contained in a slab of width 25. Our 
next goal is to give an upper bound for the value of N. To this end, we claim that 

Vol(fi i+1 ) < ^Vol(Dj), (16) 

which equivalently says 

Voi(s Q ,< Ivoi(gA). 

Let X ~ fiq.Q. and observe that P(| (X,6»j) | < 1/4) = Vol(5'n i ,0 i )/Vol((3 i fi i ). Clearly (X, 6^ 
is a log-concave random variable, and using that Cov(Proj L ./rg i n i ) = Proj L . together with the 
fact that 0i £ Li C\ S n_1 one also has that ( X , 6i) has variance 1. Using that the density of a log- 
concave distribution of unit variance is bounded by 1 one gets P(|(X, 6^) | < 1/4) < 1/2, which 
proves (16). It is now a simple application of Lemma 9 to see that for all i there exists a direction 
Vi G S n_1 such that 

(uj,Cov(0 i)vi) < Ci^n2~ 2l/n . 

where c\ > 0 is a universal constant. Together with Lemma 8, this yields 

diam(Proj,,i! ? ;) < 2^/c[n b ^2~' l ^ n . 
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By definition of N, this gives 


N <n \og l / 2 ^ 7 ^ + Jtlogi /2 ^ < n( 12 + 2c\ + 40 log(l + n/e) — logc'). 

Take d = . A straightforward calculation gives 

c d 

N > nlog(l + n/e) ^ ^ 

Finally, we define 

1 N 

d( w ) = ~ x o) 

2=1 

for all measurable IT C 1”. 

For a G Ll \ {x : |(x — x 0 , ^jv) | < 5} consider a convex function g(x) satisfying g(a) < —e. 
Define a = a — x 0 and g(x) = g(x + x 0 ) — f(x 0 ) and remark that g(a) < —e. By definition of 
N, there exists 1 < i < N such that a£fij\ O i+ 1 . Thus, equation (15) gives 


d 1 X G O : | f(x) -g(x )I > 


2 n 7 - 5 log(l + n/e ) 


max(e,/(x)) \ ) > V 


nN n 2 log(l + n/e) 


The proof is complete. 


3.4 From Lemma 4 to Lemma 3: covering the space via regions with stable 
gradients 

We say that a (z, 6, t ) is a jolly-good triplet if \z\ < A and (11) is satisfied for some appropriate 
5, namely 5 = gn 6 | \ 0 v{i+Ln/e)\ ^ > 0 a universal constant whose value will be decided upon 

later on. Intuitively given Lemma 4 it is enough to find a polynomial (in n) number of jolly-good 
triplets for which the corresponding set of ^-directions partially covers the sphere § n_1 . The notion 
of covering we use is the following: For a subset H C § n_1 and for 7 > 0, we say that H is a 
7 -cover if for all x G § n_1 , there exists 6 E H such that (6, x) > — 7 . 

Next we explain how to find jolly-good triplets in Section 3.4.1, and then how to find a 7 -cover 
with such triplets in Section 3.4.2. 

3.4.1 A contraction lemma 

The following result shows that jolly-good triplets always exist, or in other words that a convex 
function always has a relatively big set on which the gradient map is approximately constant. Quite 
naturally the proof is based on a smoothing argument together with a Poincare inequality. 

Lemma 6 Let r,r),L > 0 and 0 <£< 1 such that L > 2 r/r. Let fl C K n be a convex set, and 
f : Ll —> R be L-Lipschitz and g-strongly convex, that is 

V 2 /(x) A rj Id, Vx G fL 
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Let x 0 G f2 such that B(a; 0 ,r) C O. Then there exist a triplet (z,9,t) G B(x 0 ,r) x §" 1 x 
[ 777 -/ 2 , + 00 ) such that 

/^b(z,5 ) ((V/) -1 (B (tO, ££))) >1/2 (18) 


/or 5 


16 n 2 log — 

0 rrr 


Proof We consider the convolution g — f *h, where h is defined by 

j ( \ _ 1{^£B(0,<5)} 

U Vol(B(0, 5))' 

We clearly have that g is also 77 -strongly convex. Let x rmn be the point where g attains its minimum 
in O. We claim that 

\X7g{x)\>r)r/2, Vx e fi\B(x min ,r/2). (19) 

Indeed by strong-convexity of g we have for all y G Q, 

l^5 , (l/)l — : \^9iy')iV %min ) > I y %min \v- 

| V %min | 

which proves (19). 


Next, define B 0 = B(x 0 , r) and D = B 0 \ B(x min , r/2). It is clear that > f • Let v be 

the push forward of jid under x H > \\7g(x)\. According to (19) and by the assumption that / is 
L-Lipschitz, we know that v is supported on [gr/2, L}. Thus, there exists some t G [gr/2, L] such 

that u([t, 2t]) > (2 log . Define 

A = {x G B 0 : | Vg(x)| G [t,2t]}, 


so we know that 


Vol(A) Vol(A) Vol(D) . 


Vol(Bo) “ Vol(D) Vol(Bo) “ 4 log 


rjr 


Recall that Using Lemma 10, we now have that 

1 >' a Q(xidT , f V°l.-i(3fi») . Vol.-Qg.) Vol(Bo) „ 8rtr _!, L 

' ' 1 Vol(4) Vol(B„) Vo If.4) SSMr 10g ^' 


Vol(A) 


Consequently, there exists a point z G A for which | Vg(z)| > t and A g(z) < 8ntr 1 log —. In 


rjr 

other words, by the definition of g, we have that 

- —— f Af(x)dx < 8ntr~ l log —. 

Vol(B (z,S)) J B(ZtS) - 

Fix 1 < i < n, and define w{x) = (V/(x) — Vg(z), e^), where e* is the i-th vector of the standard 
basis. Note that 

|Vw(x)| = \V 2 f(x)ei\ < A f(x). 
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Recall that the Poincare inequality for a ball (see e.g., Acosta and Duran [2003]) implies that 


/ \w(x)\dx < 5 / \\7w(x)\dx. 

Ib(z,5) ./bo,5) 


Thus combining the last three displays, and using that 5 = ——— j~, one obtains 

16n 2 log - 


’ rj r 


Vol(B(M)) J B(z>s) 


\w(x)\dx < 85ntr 1 log ^ < ||. 


By using the fact that | Vf(x) — 'Vg(z) \ < Y^i=\ |(V/(x) — Vg(z), e*) | , this yields 

1 f 


IV/(x) - Vg(z)\dx < ft/4 < £\Vg{z)\/2. 


Vol(B(z, 5)) ,/ b(2j5) 

Finally applying Markov’s inequality one obtains (18) for the triplet (z, , V<y(z) |). 


3.4.2 Concluding the proof with the contraction lemma 

We first fix some g > 0 and, at this point, suppose that V 2 /(x) A g for all igO. Later on we will 
argue that this assumption can be removed. Define hn(x) = sup yen (x, y ), the support function of 
fl Consider the set 

0 = { 0 e§ ri - 1 : hn(6)<\} 

and let H be set of directions obtained from jolly-good triplets, more precisely, 


H = | 6 e 1 : 3 z E R n , t e (0, 1) such that (11) is true with 5 = —7 --—— 1 . 

( 2 M n° log(l + Ln/g) } 

Define 7 = Next, we show that H U 0 is a 7 -cover. Let p e S n_1 . Our objective is to find 
9 e H U 0 such that (9, p) > — 7 . 

First suppose that p (f 8 Q. In that case, by Hahn-Banach and since 0 G fi, there exists w G I" 
such that (p, w) — 1 and (w, y) < | for all y e Q. In other words, we have for 9 = A that 


hn ( 9) < 


1 

8 | w 



which implies that 9 e 0. Since ]^J/ > 0, we are done. 

We may therefore assume that p/8 6 Q. Since Cov(//o) = Id, then by Lemma 8 there exists a 
point w G 1" such that \w\ <n + 1 and B(u>, 1) C fl. Define r = 2137 ^ and take 

B 0 = B(<y9/32 + rw , r). 

Note that by convexity and by the fact that 0 G fl, we have that B 0 C f). We now use Lemma 6 
for the ball B 0 with f = 2 TT 72 , and 5 = 22Sn6 log \ 1+Ln/ri) to obtain a jolly-good triplet (z{9), 9, t ). 
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Denote z = z{6). We want to show that (9, ip) > — 7 . Observe that by convexity of / and since 
/ attains its minimum at x — 0, one has (V/(x),x) > 0 for any x. Thus, by definition of a 
jolly-good triplet one can easily see that ( 9, z) > — (£ + 5). Also by definition 2 is in B 0 and thus 
132 2 : — ip — 32rw\ < 32r. This implies: 


{9, ip) = (9,ip — 32 z + 32 rw) + 32(9, z ) — 32 r(6, w) 

> -\p - 32z + 32rw\ - 32r\w\ - 32£ - 325 > 

This concludes the proof that H U 0 is a 7 -cover. 

Next we use Lemma 11 to extract a subset H' C H such that \H'\ < n + 1 and H' U 0 is also a 
7 -cover for § n_1 . An application of Lemma 12 with M = 2n now gives that there exists v e 
such that 

p| {x : (x,9) < |} ) = On ( P {x : (x,9) < §} 

VeeiT'ue / VeeH' 

Finally, an application of Lemma 4 gives us that for all a e D \ Sq, v and every function g such that 
g(a ) < — e one has for some 9 e H', 

F-b (z{B),S) (jz G n : \f(x)-g{x)\ > 213 * maxis, fix))}} > 

Defining n = ^ F-b (z(o),6), we get 

l/W - 9(1)1 > 2‘W-Mog(l + W I? ) max(£ ’ /W) }) > Wn (20) 
It remains to remove the uniform convexity assumption. This is done by considering the function 

x 1 —> f(x) + g\x\ 2 

in place of / in the above argument. Since |x| < M < 2n for all x E D, the equation (20) becomes 

" ({* 6 ” : I m ~ 9(1)1 > 2 42 n 7 - 5 l og (l + Lnjrj) max(E ’ /W) “ 

Finally choosing 7 = () 2 one easily obtains 

9 p en:l/w - 9(1)1 > wpT7)“ (£ ’ ;(l) >}) >P 

which concludes the proof. 
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3.5 Proof of Lemma 4 

The main ingredient of the proof is the following technical result. 


Lemma 7 Let Vt C M n be a domain satisfying Diarn(Q) < M. Let f : fl — y [0, oo) be a non¬ 
negative convex function let g : fl —>■ M be a convex function satisfying g ( a ) < —£, for some 
a G fl Let zel" and consider the ball B = B(z, 5). Let D C B be a set satisfying 

(V/(x),a-i)>0, VxeD. (21) 

Assume also that dB(D) > \ and that \z — a\ > n5. Define 

A= {x: \f(x)-g(x)\ > ^-^max(e,/(x))}. 

Then one has do(A) >1/4. 


Proof For x 6 fi, define 0 a (x) = and for 6 e § n 1 write N{9) = Q a l (9). Denote by X e 
the one-dimensional Lebesgue measure on the needle N(9). Let a b,&d be the push-forward of 
fi B i dn under 0 a . Moreover, for every 6 e § n_1 , the disintegration theorem ensures the existence 
of a probability measure jio.o on N(0), defined so that for every measurable test function h one 
has 

/ , h(x)dfi D {x ) — / h(x)ddD,e(x)da£){0) (22) 

J S"- 1 J N(9) 

(in other words, fiD,e is the normalized restriction of fin to N(0)). Define the measures ( dB,e) e in 
the same manner. 

It is easy to verify that ao is absolutely continuous with respect the the uniform measure on 
S n ~\ which we denote by a. Denote q{9) := ^-(0) and w(9) := ^-(9). 

Using Lemma 7 we obtain that 


ddD,e 

d\g 


(x) 


Cn 


Vol (D)q(9) 


\x — a 


in—1 1 


'-{xGD} i 


(23) 


and 


ddB,e 

d\g 


x 


Cn 


Vol (B)w(9) 


X 


a 


n —1 ^ 


{xeB} i 


(24) 


where Cn is a constant depending only on n. 

For every 6 e S n_1 , define L(0) to be the length of the interval N(0) fl B. Consider the set 


According to Lemma 13 we have that 



w(9)da(9) < 


15 









Now, since D C B and /i b {D) > ~, we have that q(9 ) < 2 w{9) for all 9 E S n \ which gives 


0 T>(£) = / q{9)do(9) > 


Next, consider the set 


5= S"' 1 ; g(0) > 


w( 0 ) 


Since / s „_! ^da B (9) = 1 we have 


a D (S) = 


q(°) 

w(9) 


da B (9 ) = 1 - 


/ * I 

'S"-!\5 4 


Using a union bound, we have that a D (C D S) > 

Fix 9 E C fl S, we would like to give a lower bound on ii D e (A). In view of Lemma 2, we thus 
need an upper bound on the density of fiD,e- Recall that 9 E S, implies > \ and that by (23) 
and (24), we have for all x E N(9) (1 B, 


dfiDfi 

d^B,e 


[x = 


Vol (B)w(9). 
Vol (D)q(9) 




(25) 


Denote [a, b} = B fl N(6) for a, b E R n . Assume that a is the interior of the interval [a, b] (if this 
is not the case, we simply interchange between a and b). By the assumption 9 E C, we know that 
\b-a\> 32 ^. Writing Z = Va]IB n )wl0] so that, according to (24), 


Vol (B)w(0) 

d^B,e, 

~d\i [ 


x) = Z\x — a 


in—1 


{xeB} ? 


and since jiBfi is a probability measure, 

Z " 1 = 


\x — a\ n 1 dx 


where, by slight abuse of notation we assume that a,b,a E R. Thus, 

32 y/n 


Z < 


8\a — a\ n 1 


Combined with (25), this finally gives 


duD'Q < y/n \x - a 

d\a ~ 5 la — a 


U 1 < 2 8 ^ f \ b ~ a \ 

5 V la — a I 


n— 1 — 


n— 1 


= 2 ' 


1 + 


| b — a | 


a — a 


n— 1 


< 2 


1 + 


25 


n5 — <5 


n— 1 


< 2 8 e 2 


n 


8 ’ 


where in the second to last inequality we used the assumption that \z — a\ > n8. 
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Define the map U : R —* N{6) by 


U{x) = a + M(|a| — x)0 

and consider the functions /(x) = f(U(x )) and g(x) = g(U(x)). Denote x 0 = min U~ l {D IT 
N(Q)) and remark that x 0 G [|a| — 1, |a|]. Note that, thanks to equation (21), the assumption 
(9) holds for the functions f,g and the points xq. a | We can now invoke Lemma 2 for these 
functions with /x being the pullback of /i D ^ by U (x). According to the above inequality one may 
take = 2 8 e 2 ^jf^- and obtain 

LiD,e(A) > 

Integrating over 6 e C D S concludes the proof: 

> I g,£, % e{A)d(T£){Q) > -a D {CAS) > 

JsnC 1 4 


Proof [Proof of Lemma 4] Suppose that ( z,Q,t ) satisfy equation (18). Fix a G D satisfy¬ 
ing (a, 9) > | and a function g(x) satisfying g(a) < —e. Define B = B{z,5) and D = 
{x G B ; |V/(x) — 9t\ < Let /xb be the uniform measure on B. According to (18), 

we know that Hb{D) > Now, for all x E D we have that V/(x) = t(9 + y ) with \y\ < j^n^ 2 
so we get 


( V/(x), 




a — x 


\ot — x\ 


t 


> 


| a — x\ 
t 

la — x\ 


((a,0) + {a-x : y) - {x,6)) 

(I — Ffd 0 ! + \x\)n~ 2 — |x|) >0, Vx G D 


where we used the fact that D C B and so|x|<|^| + <5<^ and the fact that |a| < 2 n. Note that 
the above implies the assumption (21). Moreover remark that 

\z~a\ > \ ~ | > l > nS. 

We can thus now invoke Lemma 7 to get /x B (A ) >1/8 where 

A = {xGfi: 1/(x) f?(x)| > 2 i3M^ max(£,/(x))}. 

This completes proof. ■ 


3.6 Technical lemmas 

We gather here various technical lemmas. 
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( 26 ) 


Lemma 8 Let C be a convex body in W 1 . Then 

diam(C') < (n + 1 )||Cov(/xc-)|| 1/2 • 


On the other hand, if Cov (pc) 'Ll Id then C contains a ball of radius 1. 
Furthermore, for all v G § n_1 one has 

sup(u,x) — inf(u,x) < (n + l)(u, Cov(/i c ), v) 1 ^ 2 . 

x&C x&c 


Proof The first and second parts of the Lemma are found in [Brazitikos et ah, 2014, Section 3.2.1]. 
For the second part, we write C' = Cov(C') _ 1 / 2 C' and u = • We have 


sup(u, x) 
xec 


inf (v, x) 
xec ' 


= sup (v, Cov(C) 1 / 2 a:) - inf (v,Cov{C) 1/2 x) 

x£C x ^ C ' 

= sup (Cov(C) 1 / 2 u, x) - inf / (Cov(C') 1 / 2 u,x) 


= | Co v(C') 1/2 u 


( sup (u, X ) 
\x£ a 


inf (u, x) 

xec 1 


( 26 ) 

< (n + l)|Cov(C) 



Lemma 9 Let C C D C K n be two convex bodies with 0 6 C. Suppose that voi(z?> — ^ ^ ien 
there exists u G 8"' 1 such that 

(u,Cov(pc)u) < c-\/n5 2 / n (u, Cov(hd)u) ■ (27) 

where c> 0 is a universal constant. 


Proof Define p — po and v = pc- By applying a linear transformation to both p and u, we can 
clearly assume that Co v(p) = Id. Let f(x) be a log-concave probability density in R n . According 
to [Klartag, 2006, Corollary 1.2 and Lemma 2.7], we have that 

/ \ l / n 

ci < I sup f{x) ] (det Cov(/)) 1,/2ri < c 2 n 1//4 (28) 

\xgR n J 

where ci,c 2 > 0 are universal constants. Denote by f(x) and g{x) the densities of p and v, 
respectively. Since p, v are indicators, we have that 


sup fix) = fi 0 ) = <fy( 0 ) = 5 sup gix). 

x&M. n xCM. n 


We finally get 


(det Cov(z /)) 1 ^' 1 < c^y/ngiO) 2//n 

= c 2 5 2/n V^/( 0)“ 2/n 

< (c 2 /ci) 2 \/n(detCov(/i)) 1 /n 5 2/n = ic 2 /ci) 2 y/n8 2/n . 


The lemma follows by taking u to be the eigenvector corresponding to the smallest eigenvalue of 

Cov(z/). ■ 
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Lemma 10 Let g be a convex function defined on a Euclidean ball B C R r \ Let A C B be a 
closed set such that Vx G A |Vg(x)| < t. Then 



Ag(x)dx < t Vol n _i (dB). 


Proof Since g is convex, we can write 


g(x) = sup w y (x) 

y&B 

where w y (x) — (x — y, Vg(y)) + g(y). Define 

g(x) = suptc y (a;). 

y£A 

Clearly g is convex and g(x) = g(x) for all x G A. Moreover | Vg(x)\ < t for all x G M n . Using 
Gauss’s theorem, we have 

/ Ag(x)dx < / Ag(x)dx = / (Vg(x),n(x))d'H n _i(x) < tVol n _i(dB), 

J a Jb J dB 

which concludes the proof ■ 

Let 7 > 0. Recall that we say that H C S n_1 is a y-covcr if for all x G § n_1 , there exists 
9 G H satisfying 

(0,x)>- 7 . (29) 

Lemma 11 Let H C S ™” 1 be a 7 -cover. Then there exists a subset I C H with |/| < n + 1 such 
that I is a 'y-cover. 

Proof We first claim that there is a point y G Con v(H) with \y\ < 7 . Indeed, if we assume 
otherwise then by Hahn-Banach there exists 9 G § n 1 such that (9, 9) > 7 for all 9 G H, which 
means the vector —9 violates the assumption (29). By Caratheodory’s theorem, there exists / C H 

with \I\ < n + 1 such that y G Conv(J). Write I = (9i,9 n+ f). Now let iGl” with \x\ < 1. 

Then since {x, y) > — 7 , we have 

n+1 

(x,9i) > -7 

i= 1 

for some non-negative coefficients {a,;}"A , 1 satisfying o, = 1. Thus there exists 9 E I for 
which (29) holds. ■ 


Lemma 12 Let f) C M n be a convex set with diam(fl) < M and such that 0 G Let H be a 
y-cover. Then there exists 9 G 1 such that 

{a Gfl : W G H, {a, 9) < My} C {a G fl : \(a,9)\ < 2 My}. 
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Proof Since {a £ 0 : \/9 £ H, (a, 9) < M 7 } is a convex set which contains 0, showing 
that it does not contain a ball of radius 2 M 7 is enough to show that it is included in some slab 
{a £ 0 : | (a, 9) \ < 2My}. Now suppose that our set of interest {a : \/9 £ H, (a, 9) < My} actu¬ 
ally contains a ball B(x, 2 M 7 ) with |x| £ (0, M). Let 6 £ H be such that (A, 6 *) > — 7 , and thus 
in particular (x, 9) > —M 7 . Then one has by the inclusion assumption that (9,x + 2My9) < M 7 , 
but on the other hand one also has (9, x + 27 M9) > 7 M which yields a contradiction, thus con¬ 
cluding the proof. ■ 


Lemma 13 Let 5 > 0, xq £ R n , B = B(x 0 , 5) and a £ R n \I?. Forx £ R n , define O a (x) = Zf , 
and let gb be the push-forward of pb under 0 Q . For every 9 £ §” _1 , define L(9 ) to be f/ze length 
of the interval 0“ 1 (6 | ) D B. Then one has 


‘*( 9:£(9)> 3^s)4 

Proof Note that, by definition, 

A ry — rp A 

x & B and x + - e B ^ L (Q a (x)) > 

32 y/n \a — x\ 32 yjn 

Furthermore it is easy to show that for all y £ B, 

da — x 0 „ da — y „ 

V + 7773 7 = "j- 1 £ B => y + r - - £ 5. 

32a/ 77. |a — x 0 | Sly/n \a — y\ 

Thus letting X ~ p B we see that the lemma will be concluded by showing that 


P 



d a — x 0 
32 y/n \a — x 0 




Defining B = B (x 0 — ^ 7 ^ ^, the statement boils down to proving that P(X E B) > 7/8. 

By applying an affine linear transformation to both B and B, this is equivalent to 

V°i(b (- 7770 , l) n B l)) ^ 7 

Vol(B(0,1)) “ 8 

where e\ is the first vector of the standard basis. Next, by symmetry around the hyperplane ef, we 
have 

Vol ( B (-64770’ 1 ) nB (e477 e i’ x )) _ 2Vol ( B (-64770’ x ) n 4; 4’0> ^ °}) 
Vol(B(0,1)) ~~ Vol(B(0,1)) ' 


Thus, it is enough to show that P [\Z\ > J > | where Z = {X',ei) and X' ~ A*b(o,i)- 

Observe that Var [Z\ > -P and that Z is log-concave (in particular the density of Z/ Var | Z is 
bounded by 1). This implies that for any t > 0 

P (|Z| < t\/Vav[zfj < 2 1, 
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and thus the lemma follows by taking t 


16 ' 


Lemma 14 Let A C M". For x G M n , define 0 Q (x) = and let a a be the push-forward 

of pa under 0 a . Assume that a a is absolutely continuous with respect the the uniform measure 
a on 1 and denote q{9) := '-Iff (6). Fincdly let pA,e be the normalized restriction of p a on 
N(9) = ©^ 1 (6 ) ), defined so that for every measurable test function h one has 


y h(x)dpn(x) = / h(x)dpA,e{x)doA(9). 

J S"- 1 JN(0) 

Denoting ( n for the (n — 1)-dimensioned Hausdorjf measure of one then obtains 


(30) 


dp A,6 

d\o 


[X = 


Cn 


Vol (A)q(9) 


\x — a\ n ~ l l 


{xGB}- 


(31) 


Proof First observe that the existence of pA,e is ensured by the disintegration theorem. Now 
remark that using the integration by polar coordinates formula we have for every measurable test 
function p. 


p{x)dx = C„ 


•*-! JO 


r n l p(a + r9)drda(9). 


Now, by definition of qf), we have for every test function p. 


r»oo P poo 

FTl— I r~Cf\ J _ I I ^n— 1 //)\ — 1 , 


/ r n p(a + r9)drd<j(9) = / r n q(9) p(a + r9)drd<JA{9). 

I s™- 1 Jo J s™- 1 Jo 


Taking p(x) = h(x)l xe A, we finally get 

1 


h(x)dpA(x) = 


Vol(A) J A 
Cn f 
Vo\(A) 


h{x)dx 


n-- 1 J o 


r n 1 q(9) 1 h(a + r9)l {a+reeA }drda A (9). 


Since the above is true for every measurable function h, together with equation (30) we get that for 
every function h and every 9 G S n_1 , one must have 


[ h(x)dp e (x) = ^ [ 

'n( 6) Vol(D)q(9) J o 

Cn f 


Vol( 2 l)g(#) J jv( 0 ) 

and the claimed identity (31) follows. 


r n 1 h(a + r9)l {a+r o £A }dr 
\x - a\ n ~ l h(x)l {x£A }d\e(x) 
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